Factors affecting maternal participation in the genetic component of the National Birth Defects Prevention Study—United States, 1997–2007

As epidemiological studies expand to examine gene–environment interaction effects, it is important to identify factors associated with participation in genetic studies. The National Birth Defects Prevention Study is a multisite case–control study designed to investigate environmental and genetic risk factors for major birth defects. The National Birth Defects Prevention Study includes maternal telephone interviews and mailed buccal cell self-collection kits. Because subjects can participate in the interview, independent of buccal cell collection, detailed analysis of factors associated with participation in buccal cell collection was possible

Enhanced feedback interventions to promote evidence-based blood transfusion guidance and reduce unnecessary use of blood components:The AFFINITIE research programme including two cluster factorial RCTs

Background: Blood transfusion is a common but costly treatment. Repeated national audits in the UK suggest that up to one-fifth of transfusions are unnecessary when judged against recommendations for good clinical practice. Audit and feedback seeks to improve patient care and outcomes by comparing clinical care against explicit standards. It is widely used internationally in quality improvement. Audit and feedback generally has modest but variable effects on patient care. A considerable scope exists to improve the impact that audit and feedback has, particularly through head-to-head trials comparing different ways of delivering feedback. Objectives: The AFFINITIE (Development & Evaluation of Audit and Feedback INterventions to Increase evidence-based Transfusion practIcE) programme aimed to design and evaluate enhanced feedback interventions, within a national blood transfusion audit programme, to promote evidence-based guidance and reduce the unnecessary use of blood components. We developed, piloted and refined two feedback interventions, ‘enhanced content’ and ‘enhanced follow-on’ (workstream 1), evaluated the effectiveness and cost-effectiveness of the two feedback interventions compared with standard feedback practice (workstream 2), examined intervention fidelity and contextual influences (workstream 3) and developed general implementation recommendations and tools for other audit and feedback programmes (workstream 4). Design: Interviews, observations and documentary analysis in four purposively sampled hospitals explored contemporary practice and opportunities for strengthening feedback. We developed two interventions: ‘enhanced content’, to improve the clarity and utility of feedback reports, and ‘enhanced follow-on’, to help hospital staff with action-planning (workstream 1). We conducted two linked 2 × 2 factorial cross-sectional cluster-randomised trials within transfusion audits for major surgery and haematological oncology, respectively (workstream 2). We randomised hospital clusters (the organisational level at which hospital transfusion teams operate) to enhanced or standard content or enhanced or standard follow-on. Outcome assessment was masked to assignment. Decision-analytic modelling evaluated the costs, benefits and cost-effectiveness of the feedback interventions in both trials from the perspective of the NHS. A parallel process evaluation used semistructured interviews, documentary analyses and web analytics to assess the fidelity of delivery, receipt and enactment and to identify contextual influences (workstream 3). We explored ways of improving the impact of national audits with their representatives (workstream 4). Setting and participants: All NHS hospital trusts and health boards participating in the National Comparative Audit of Blood Transfusions were invited to take part. Among 189 hospital trusts and health boards screened, 152 hospital clusters participated in the surgical audit. Among 187 hospital trusts and health boards screened, 141 hospital clusters participated in the haematology audit. Interventions: ‘Enhanced content’ aimed to ensure that the content and format of feedback reports were consistent with behaviour change theory and evidence. ‘Enhanced follow-on’ comprised a web-based toolkit and telephone support to facilitate local dissemination, planning and response to feedback. Main outcome measures: Proportions of acceptable transfusions, based on existing evidence and guidance and algorithmically derived from national audit data. Data sources: Trial primary outcomes were derived from manually collected, patient-level audit data. Secondary outcomes included routinely collected data for blood transfusion. Results: With regard to the transfusions in the major surgery audit, 135 (89%) hospital clusters participated from 152 invited. We randomised 69 and 66 clusters to enhanced and standard content, respectively, and 68 and 67 clusters to enhanced and standard follow-on, respectively. We analysed a total of 2222 patient outcomes at 12 months in 54 and 58 (enhanced and standard content, respectively) and 54 and 58 (enhanced and standard follow-on, respectively) hospital clusters. With regard to the haematology audit, 134 hospital clusters (95%) participated from 141 invited. We randomised 66 and 68 clusters to enhanced and standard content, respectively, and 67 clusters to both enhanced and standard follow-on. We analysed a total of 3859 patient outcomes at 12 months in 61 and 61 (enhanced and standard content, respectively) and 63 and 59 (enhanced and standard follow-on) hospital clusters. We found no effect of either of the enhanced feedback interventions in either trial across all outcomes. Incremental enhanced intervention costs ranged from £18 to £248 per site. The enhanced feedback interventions were dominated by the standard intervention in cost-effectiveness analyses. The interventions were delivered as designed and intended, but subsequent local engagement was low. Although the enhancements were generally acceptable, doubts about the credibility of the blood transfusion audits undermined the case for change. Limitations: Limitations included the number of participating clusters; loss to follow-up of trial clusters, reducing statistical power and validity; incomplete audit and cost data contributing to outcome measures; participant self-selection; reporting; missing data related to additional staff activity generated in response to receiving feedback; and recall biases in the process evaluation interviews. Conclusions: The enhanced feedback interventions were acceptable to recipients but were more costly and no more effective than standard feedback in reducing unnecessary use of blood components, and, therefore, should not be recommended on economic grounds. Future work: We have demonstrated the feasibility of embedding ambitious large-scale rigorous research within national audit programmes. Further head-to-head comparisons of different feedback interventions are needed in these programmes to identify cost-effective ways of increasing the impact of the interventions

Application of theory to enhance audit and feedback interventions to increase the uptake of evidence-based transfusion practice: an intervention development protocol

Background: Audits of blood transfusion demonstrate around 20% transfusions are outside national recommendations and guidelines. Audit and feedback is a widely used quality improvement intervention but effects on clinical practice are variable, suggesting potential for enhancement. Behavioural theory, theoretical frameworks of behaviour change and behaviour change techniques provide systematic processes to enhance intervention. This study is part of a larger programme of work to promote the uptake of evidence-based transfusion practice. Objectives: The objectives of this study are to design two theoretically enhanced audit and feedback interventions; one focused on content and one on delivery, and investigate the feasibility and acceptability. Methods: Study A (Content): A coding framework based on current evidence regarding audit and feedback, and behaviour change theory and frameworks will be developed and applied as part of a structured content analysis to specify the key components of existing feedback documents. Prototype feedback documents with enhanced content and also a protocol, describing principles for enhancing feedback content, will be developed. Study B (Delivery): Individual semi-structured interviews with healthcare professionals and observations of team meetings in four hospitals will be used to specify, and identify views about, current audit and feedback practice. Interviews will be based on a topic guide developed using the Theoretical Domains Framework and the Consolidated Framework for Implementation Research. Analysis of transcripts based on these frameworks will form the evidence base for developing a protocol describing an enhanced intervention that focuses on feedback delivery. Study C (Feasibility and Acceptability): Enhanced interventions will be piloted in four hospitals. Semi-structured interviews, questionnaires and observations will be used to assess feasibility and acceptability. Discussion: This intervention development work reflects the UK Medical Research Council’s guidance on development of complex interventions, which emphasises the importance of a robust theoretical basis for intervention design and recommends systematic assessment of feasibility and acceptability prior to taking interventions to evaluation in a full-scale randomised study. The work-up includes specification of current practice so that, in the trials to be conducted later in this programme, there will be a clear distinction between the control (usual practice) conditions and the interventions to be evaluated

Cost and Cost-Effectiveness Assessments of Newborn Screening for Critical Congenital Heart Disease Using Pulse Oximetry: A Review

Screening newborns for critical congenital heart disease (CCHD) using pulse oximetry is recommended to allow for the prompt diagnosis and prevention of life-threatening crises. The present review summarizes and critiques six previously published estimates of the costs or cost-effectiveness of CCHD screening from the United Kingdom, United States, and China. Several elements that affect CCHD screening costs were assessed in varying numbers of studies, including screening staff time, instrumentation, and consumables, as well as costs of diagnosis and treatment. A previous US study that used conservative assumptions suggested that CCHD screening is likely to be considered cost-effective from the healthcare sector perspective. Newly available estimates of avoided infant CCHD deaths in several US states that implemented mandatory CCHD screening policies during 2011–2013 suggest a substantially larger reduction in deaths than was projected in the previous US cost-effectiveness analysis. Taking into account these new estimates, we estimate that cost per life-year gained could be as low as USD 12,000. However, that estimate does not take into account future costs of health care and education for surviving children with CCHD nor the costs incurred by health departments to support and monitor CCHD screening policies and programs

What is an adequate sample size? Operationalising data saturation for theory-based interview studies

In interview studies, sample size is often justified by interviewing participants until reaching “data saturation”. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on Theory of Planned Behaviour, designed to identify three belief categories (Behavioural, Normative, Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or study-wise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget’s disease of the bone reported 44 shared beliefs about taking genetic testing. Study-wise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies

Strategies for implementing screening for critical congenital heart disease

Although newborn screening for critical congenital heart disease (CCHD) was recommended by the US Health and Human Services Secretary's Advisory Committee on Heritable Disorders in Newborns and Children to promote early detection, it was deemed by the Secretary of the HHS as not ready for adoption pending an implementation plan from HHS agencies. To develop strategies for the implementation of safe, effective, and efficient screening. A work group was convened with members selected by the Secretary's Advisory Committee on Heritable Disorders in Newborns and Children, the American Academy of Pediatrics, the American College of Cardiology Foundation, and the American Heart Association. On the basis of published and unpublished data, the work group made recommendations for a standardized approach to screening and diagnostic follow-up. Key issues for future research and evaluation were identified. The work-group members found sufficient evidence to begin screening for low blood oxygen saturation through the use of pulse-oximetry monitoring to detect CCHD in well-infant and intermediate care nurseries. Research is needed regarding screening in special populations (eg, at high altitude) and to evaluate service infrastructure and delivery strategies (eg, telemedicine) for nurseries without on-site echocardiography. Public health agencies will have an important role in quality assurance and surveillance. Central to the effectiveness of screening will be the development of a national technical assistance center to coordinate implementation and evaluation of newborn screening for CCHD

How Well Do ICD‐9‐CM Codes Predict True Congenital Heart Defects? A Centers for Disease Control and Prevention‐Based Multisite Validation Project

Background The Centers for Disease Control and Prevention's Surveillance of Congenital Heart Defects Across the Lifespan project uses large clinical and administrative databases at sites throughout the United States to understand population‐based congenital heart defect (CHD) epidemiology and outcomes. These individual databases are also relied upon for accurate coding of CHD to estimate population prevalence. Methods and Results This validation project assessed a sample of 774 cases from 4 surveillance sites to determine the positive predictive value (PPV) for identifying a true CHD case and classifying CHD anatomic group accurately based on 57 International Classification of Diseases, Ninth Revision, Clinical Modification (ICD‐9‐CM) codes. Chi‐square tests assessed differences in PPV by CHD severity and age. Overall, PPV was 76.36% (591/774 [95% CI, 73.20–79.31]) for all sites and all CHD‐related ICD‐9‐CM codes. Of patients with a code for complex CHD, 89.85% (177/197 [95% CI, 84.76–93.69]) had CHD; corresponding PPV estimates were 86.73% (170/196 [95% CI, 81.17–91.15]) for shunt, 82.99% (161/194 [95% CI, 76.95–87.99]) for valve, and 44.39% (83/187 [95% CI, 84.76–93.69]) for “Other” CHD anatomic group (X2=142.16, P64 years of age, (X2=4.23, P<0.0001). Conclusions While CHD ICD‐9‐CM codes had acceptable PPV (86.54%) (508/587 [95% CI, 83.51–89.20]) for identifying whether a patient has CHD when excluding patients with ICD‐9‐CM codes for “Other” CHD and code 745.5, further evaluation and algorithm development may help inform and improve accurate identification of CHD in data sets across the CHD ICD‐9‐CM code groups

Health Care Usage Among Adolescents With Congenital Heart Defects at 5 Sites in the United States, 2011 to 2013

Background We sought to characterize health care usage for adolescents with congenital heart defects (CHDs) using population‐based multisite surveillance data. Methods and Results Adolescents aged 11 to 18 years with ≥1 CHD‐related diagnosis code and residing in 5 US sites were identified in clinical and administrative data sources for the years 2011 to 2013. Sites linked data on all inpatient, emergency department (ED), and outpatient visits. Multivariable log‐binomial regression models including age, sex, unweighted Charlson comorbidity index, CHD severity, cardiology visits, and insurance status, were used to identify associations with inpatient, ED, and outpatient visits. Of 9626 eligible adolescents, 26.4% (n=2543) had severe CHDs and 21.4% had Charlson comorbidity index >0. At least 1 inpatient, ED, or outpatient visit was reported for 21%, 25%, and 96% of cases, respectively. Cardiology visits, cardiac imaging, cardiac procedures, and vascular procedures were reported for 38%, 73%, 10%, and 5% of cases, respectively. Inpatient, ED, and outpatient visits were consistently higher for adolescents with severe CHDs compared with nonsevere CHDs. Adolescents with severe and nonsevere CHDs had higher health care usage compared with the 2011 to 2013 general adolescent US population. Adolescents with severe CHDs versus nonsevere CHDs were twice as likely to have at least 1 inpatient visit when Charlson comorbidity index was low (Charlson comorbidity index =0). Adolescents with CHDs and public insurance, compared with private insurance, were more likely to have inpatient (adjusted prevalence ratio, 1.5 [95% CI, 1.3–1.7]) and ED (adjusted prevalence ratio, 1.6 [95% CI, 1.4–1.7]) visits. Conclusions High resource usage by adolescents with CHDs indicates a substantial burden of disease, especially with public insurance, severe CHDs, and more comorbidities

Factors affecting maternal participation in the genetic component of the National Birth Defects Prevention Study—United States, 1997–2007

PURPOSE: As epidemiological studies expand to examine gene–environment interaction effects, it is important to identify factors associated with participation in genetic studies. The National Birth Defects Prevention Study is a multisite case–control study designed to investigate environmental and genetic risk factors for major birth defects. The National Birth Defects Prevention Study includes maternal telephone interviews and mailed buccal cell self-collection kits. Because subjects can participate in the interview, independent of buccal cell collection, detailed analysis of factors associated with participation in buccal cell collection was possible. METHODS: Multivariable logistic regression models were used to identify the factors associated with participation in the genetic component of the study. RESULTS: Buccal cell participation rates varied by race/ethnicity (non-Hispanic whites, 66.9%; Hispanics, 60.4%; and non-Hispanic blacks, 47.3%) and study site (50.2–74.2%). Additional monetary incentive following return of buccal cell kit and shorter interval between infant’s estimated date of delivery and interview were associated with increased participation across all racial/ethnic groups. Higher education and delivering an infant with a birth defect were associated with increased participation among non-Hispanic whites and Hispanics. CONCLUSION: Factors associated with participation varied by race/ethnicity. Improved understanding of factors associated with participation may facilitate strategies to increase participation, thereby improving generalizability of study findings